Method and apparatus for providing tactile message

ABSTRACT

The present invention relates to a tactile message providing method and a tactile message providing device. Embodiments of the present invention provide a tactile message providing method for a tactile sense in a mobile communication terminal device, the method including: (a) driving a tactile message program; (b) receiving a tactile pattern; (c) converting the tactile pattern into a pattern signal; and (d) transmitting the pattern signal to a reception terminal device, wherein the tactile message program includes a tactile pattern input window or a tactile switch icon for switching a text input window to a tactile pattern input window, wherein the pattern signal is a signal capable of transmitting tactile information by operating a tactile delivery unit of the reception terminal device.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a divisional of U.S. Ser. No. 16/094,904, filed Oct.19, 2018, the contents of which are incorporated herein by reference.

TECHNICAL FIELD

The present invention relates to a tactile message providing method anda tactile message providing device. More particularly, the presentinvention relates to a tactile message providing method and a tactilemessage providing device that may provide tactile information to acounterpart in real time by a user inputting a tactile pattern orselecting a previously stored tactile pattern.

BACKGROUND ART

As the supply rate of the wireless communication terminal increases, itbecomes a necessity of life of modern people and is developed as awearable type device which may be worn by the user in the existinghandheld type.

Also, in terms of communication services, it evolves from existing voicecalls and short messages and evolves toward providing multimediaservices including various data transmission and various additionalservices.

Short Message Service (SMS) among existing communication services usinga wireless communication terminal allows the user to convenientlycontact and communicate with each other in real time, but haslimitations in transmitting the emotion or feeling of the user. Toovercome this, a multimedia message service (MMS) and a messengerservice (Messenger Service), including pictures, videos, and emoticons,are used. However, most of these tools are also visual, so that it haslimitations in conveying rich emotions and feelings of users.

In addition, the service providing the conventional tactile sense ismostly limited to the vibration, and there is a problem that it ismonotonous because it may not give direction to the tactile sense. Inaddition, since each tactile feedback pre-stored in the memory unit isread and transmitted, it is not sufficient to transmit a tactile sensereflecting user's emotions or emotions in real time.

DISCLOSURE OF THE INVENTION Technical Problem

The present invention provides a tactile message providing method and atactile message providing method through which as the tactile sense istransmitted, the limited user's expression through the existing messageservice relying primarily on visual perception is avoided and theemotions that users feel in various situations allow other person tofeel the same way.

The present invention also provides a tactile message providing methodand a tactile message providing device that transmit various tactilefeelings such as vibration, squeeze, tightening, hitting, pushing,tapping, or tilting more sensitively to a receiver by promptly inputtinga feeling of a sender in a tactile pattern.

Technical Solution

Embodiments of the present invention provide a tactile message providingmethod for a tactile sense in a mobile communication terminal device,the method including: (a) driving a tactile message program; (b)receiving a tactile pattern; (c) converting the tactile pattern into apattern signal; and (d) transmitting the pattern signal to a receptionterminal device, wherein the tactile message program includes a tactilepattern input window or a tactile switch icon for switching a text inputwindow to a tactile pattern input window, wherein the pattern signal isa signal capable of transmitting tactile information by operating atactile delivery unit of the reception terminal device.

In other embodiments of the present invention, a tactile messageproviding device for transmitting a tactile sense includes: a displayunit for displaying a tactile message program having a tactile patterninput window or a tactile switch icon for switching a text input windowto a tactile pattern input window; an input unit for receiving a tactilepattern from the tactile pattern input window; a control unit fordetecting a pattern signal of the tactile pattern; a communication unitfor transmitting the pattern signal to a reception terminal device; anda tactile delivery unit for transmitting tactile information, whereinthe pattern signal is a signal capable of transmitting tactileinformation by operating a tactile delivery unit of the receptionterminal device.

Advantageous Effects

According to the present invention configured as described above, as thetactile sense is transmitted, the existing message service relyingprimarily on visual perception is avoided and the emotions that usersfeel in various situations allow other person to feel the same way.

In addition, according to the present invention, as promptly inputting afeeling of a sender in a tactile pattern, various tactile feelings suchas vibration, squeeze, tightening, hitting, pushing, tapping, or tiltingare more sensitively transmitted to a receiver.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a view schematically showing a configuration of an overallsystem for providing a tactile message according to an embodiment of thepresent invention.

FIG. 2 is a view schematically showing a configuration of a tactilemessage providing device according to an embodiment of the presentinvention.

FIG. 3 is a schematic view of a mobile communication terminal devicehaving a tactile delivery unit according to an embodiment of the presentinvention.

FIG. 4 is a view showing a schematic configuration of a tactile deliveryunit according to an embodiment of the present invention.

FIG. 5 is a view showing a tactile delivery unit according to the firstembodiment of the present invention.

FIG. 6 is a view showing a tactile delivery unit according to the secondembodiment of the present invention.

FIG. 7 is a view showing various shapes of a tactile delivery unitaccording to an embodiment of the present invention.

FIG. 8 is a view showing a tactile delivery unit according to the thirdembodiment of the present invention.

FIG. 9 is a view showing a tactile delivery unit according to the fourthembodiment of the present invention.

FIG. 10 is a view showing a tactile delivery unit according to the fifthembodiment of the present invention.

FIG. 11 is a flowchart showing a tactile message transmission processaccording to an embodiment of the present invention.

FIG. 12 is a flowchart showing a tactile message reception processaccording to an embodiment of the present invention.

FIG. 13 is a view showing a screen of a tactile message programaccording to an embodiment of the present invention.

FIG. 14 is a view showing a tactile pattern input window according to anembodiment of the present invention.

FIG. 15 is a view showing a pattern signal for a tactile patternaccording to an embodiment of the present invention.

FIGS. 16 and 17 are views showing that a tactile pattern input window710 according to an embodiment of the present invention is divided intoa plurality of virtual regions to receive a tactile pattern.

FIG. 18 is a view showing that a symbol is provided in a tactile patterninput window according to an embodiment of the present invention.

FIG. 19 is a view showing that a tactile pattern input window accordingto another embodiment of the present invention is divided into aplurality of virtual regions and a symbol is provided.

FIG. 20 is a view showing a screen for selecting a tactile emoticonaccording to an embodiment of the present invention.

FIG. 21 is a view showing a screen for selecting a user emoticonaccording to an embodiment of the present invention.

FIG. 22 is a view showing a pattern signal for various emotionsaccording to an embodiment of the present invention.

FIG. 23 is a view showing a screen for receiving a tactile messageaccording to an embodiment of the present invention.

DESCRIPTION OF REFERENCE NUMERALS

-   -   100: transmission terminal device    -   110: input unit    -   120: display unit    -   130: memory unit    -   140: tactile delivery unit    -   141: tactile unit    -   145: magnetic field generation unit    -   150: content delivery unit    -   160: communication unit    -   170: control unit    -   200: reception terminal device    -   300: communication network    -   400: server    -   500, 600, 700: screens of a tactile message program    -   510, 601, 710: input windows for inputting tactile patterns    -   703: tactile switch icon    -   705: emoticon input icon    -   706: tactile emoticon    -   707: user emoticon    -   711, 715: virtual region    -   720: dialog window    -   721, 722, 723: tactile message    -   S: symbol

MODE FOR CARRYING OUT THE INVENTION

Reference is made to the accompanying drawings shown as examples of theembodiments. These embodiments are described in detail to allow thoseskilled in the art to practice the present invention. It should beunderstood that the various embodiments of the present invention aredifferent, but need not be mutually exclusive. For example, specificforms, structures, and characteristics described herein may beimplemented in other embodiments without departing from the spirit andscope of the present invention in relation to one embodiment. It alsoshould be understood that the position or arrangement of the individualcomponents in each disclosed embodiment may be varied without departingfrom the spirit and scope of the present invention. Therefore, thefollowing detailed description is not to be taken in a limiting sense,and if properly explained, the scope of the invention is to be limitedonly by the appended claims, along with the full scope of equivalents towhich such claims are entitled. In the drawings, like reference numeralsrefer to the same or similar functions throughout the several aspects,and length and area, thickness, and the like, and their shapes may beexaggerated for convenience.

Hereinafter, embodiments of the present invention will be described indetail with reference to the accompanying drawings in order that thoseskilled in the art easily carry out the present invention.

Configuration of Entire System

FIG. 1 is a view schematically showing a configuration of an overallsystem for providing a tactile message according to an embodiment of thepresent invention.

Referring to FIG. 1, the overall system for providing a tactile messageaccording to an exemplary embodiment of the present invention includes atransmission terminal device 100, a reception terminal device 200, acommunication network 300, and a server 400.

The transmission terminal device 100 and the reception terminal device200, which are mobile communication terminal devices, are terminaldevices having similar configurations and functions, and collectivelyrefer to an electronic device that may access a mobile communicationnetwork 300 and perform voice communication, data communication, and thelike. Any digital device that is portable and has a memory means and hasa computing capability by mounting a microprocessor, for example,wearable devices which may be attached to the user's body, such as,smartphones, smart watches, and the like, tablets, and PDAs, may beadopted as the mobile communication terminal devices 100 and 200according to the present invention.

The communication network 300 may be configured without itscommunication modes such as wired and wireless and may be configuredwith various communication networks such as mobile communicationnetwork, Local Area Network (LAN), Metropolitan Area Network (MAN), WideArea Network (WAN), and the like. Preferably, the communication network300 in the present invention is a well-known World Wide Web (WWW) orCode Division Multiple Access (CDMA), Wideband Code Division MultipleAccess (WCDMA), and Global System for Mobile (GSM) communicationsnetwork. Although not shown in the drawing, a base station is interposedbetween the mobile communication terminal devices 100 and 200 and thecommunication network 300 to mediate a data channel.

The server 400 provides a tactile message program or application to themobile communication terminal device 100 and 200, obtains accessinformation, identification information, communication information, etc.of the mobile communication terminal devices 100 and 200, and controls apart of functions of the mobile communication terminal devices 100 and200 with reference to the same. The access information may include thelogin information of the user in the tactile message program, theidentification information may include a device serial number (ESN), atelephone number, and the like, and the communication information mayinclude a message signal between a sender and a receiver but is notlimited thereto.

Configuration of Tactile Message Providing Device

FIG. 2 is a view schematically showing a configuration of a tactilemessage providing device according to an embodiment of the presentinvention. It may be understood that the tactile message providingdevice according to the present invention includes both mobilecommunication terminal devices 100 and 200 themselves or a module havinga function of transmitting tactile information connected to a mobilecommunication terminal device 100 and 200. In this specification, thetactile message providing device is assumed to be the mobilecommunication terminal devices 100 and 200 themselves. The tactilemessage providing device may be described in combination with thetransmission terminal device 100 and the reception terminal device 200.

Referring to FIG. 2, the tactile message providing device 100 accordingto an exemplary embodiment of the present invention includes an inputunit 110, a display unit 120, a memory unit 130, a tactile delivery unit140, a content delivery unit 150, a communication unit 160, and acontrol unit 170.

The input unit 110 may perform a function of receiving informationnecessary for the operation of the tactile message providing device 100from the user. For example, the input unit 110 may include variousfunction keys including a touch panel, a hard key or a button, andfurther, may include sensing means such as an extended input means suchas a mouse and a keyboard, an acceleration sensor, a gyro sensor, agravity sensor, and a magnet sensor. In particular, in the presentinvention, the input unit 110 may mean input means for sending messagessuch as tactile, visual, and auditory, and means for inputting tactilepatterns.

The display unit 120 performs a function for displaying informationrelated to a transmission/reception message, operation guide, operationstate, and the like, and for example, may include a display device suchas an OLED, an LED, and an LCD. In particular, in the present invention,the display unit 120 may mean a portion for driving a driven tactilemessage program, a display region, and the like.

The memory unit 130 may store data necessary for operation of thetactile message providing device 100. In particular, in the presentinvention, a tactile message program may be installed in the memory unit130, and a tactile pattern DB, a tactile emoticon, a user emoticon, andthe like may be stored.

The tactile delivery unit 140 may convert the tactile pattern inputtedby the sender into tactile information and transmit the tactile sense tothe receiver. A detailed description of the tactile delivery unit 140will be given later.

The content delivery unit 150 may perform a function of transmittinginformation other than information that may be visually transmittedthrough the display unit 120. For example, it may include a speaker thattransmits auditory information such as sounds and sound effects, a meansthat transmits smell information, and the like.

The communication unit 160 functions to enable datatransmission/reception from/to the tactile message providing device 100.In particular, in the present invention, the communication unit 160performs a function of transmitting a pattern signal to another terminaldevice 200, transmitting and receiving message information, andreceiving information on control of the tactile message providing device100 from the server 400 through the communication network 300.

The control unit 170 performs a series of functions to control the flowof signals between the input unit 110, the display unit 120, the memoryunit 130, the tactile delivery unit 140, the content delivery unit 150,and the communication unit 160. In particular, in the present invention,the control unit 170 may perform a function of digitizing the tactilepattern inputted through the input unit 110 into a pattern signal,transmitting the pattern signal to the communication unit 160, andtransmitting it to the terminal device 200.

Configuration of Tactile Delivery Unit

Hereinafter, the configuration and various embodiments of the tactiledelivery unit 140 will be described in detail.

FIG. 3 is a schematic view of mobile communication terminal devices 100a and 100 b having a tactile delivery unit 140 according to anembodiment of the present invention. (a) of FIG. 3 shows an embodimentin which a tactile delivery unit 140 is disposed on the rear surface ofthe smartphone 100 a. (b) of FIG. 3 shows an embodiment in which atactile delivery unit 140 is provided on the band inner circumferentialsurface of the smart watch 100 b. In addition, the arrangement,location, number, size, etc. of the tactile delivery unit 140 may bemodified without limitation and within a purpose range of providingtactile information in contact with a part of the user, it is noted thatthere is no restriction on the shape of the tactile delivery unit 140.

Referring to (a) of FIG. 3, a plurality of tactile delivery units 140may be disposed on the rear surface of the smartphone 100 a. Forexample, the tactile delivery unit 140 may be arranged in a matrix.Reference numerals are shown in order of 140 aa, 140 ba, 140 ca, . . .in the row direction, and 140 aa, 140 ab, 140 ac, . . . , in the columndirection. Referring to (b) of FIG. 3, a plurality of tactile deliveryunits 140 may be disposed on the inner circumferential surface of theband of the smart watch 100 b. For example, the tactile delivery unit140 may be arranged at regular intervals along the band direction.Reference numerals are indicated in the order of 140 a, 140 b, . . . ,140 f from one end of the band to the other end.

Each tactile delivery unit 140 may operate independently, and theintensity, type, delivery time, etc. of the tactile sense may beindependently controlled according to the tactile pattern.

FIG. 4 is a view showing a schematic configuration of a tactile deliveryunit 140 according to an embodiment of the present invention.

Referring to FIG. 4, the tactile delivery unit 140 includes a tactileunit 141 composed of magnetic particles 142 and a matrix material 143,and a magnetic field generation unit 145 for applying a magnetic fieldto the tactile unit 141.

The tactile unit 141:141 a-141 e is made of magnetic material 142, forexample, nano or micron sized iron or ferrite particles, and a matrixmaterial 143, for example, rubber or other polymeric material. Also, thetactile unit 141 may be a Magneto-Rheological Elastomer (MRE), and theMRE is an elastomeric material containing particles capable of reactingto an external magnetic field. Since the MRE contains magnetic particlesthat may be magnetized by an external magnetic field in the elastomericmaterial, characteristics such as stiffness, tensile strength andelongation may be changed by application of an external magnetic field.In addition, the tactile unit 141 may be formed by selecting at leastone of a polygonal phenomenon such as a micro projection, a hollowcylinder, a dome, a plate shape, a seesaw shape, or a tunnel shape.

The magnetic field generation unit 145 is located above or below thetactile unit 141 to form a magnetic field and the magnetic particle 142in the tactile unit 141 reacts to this magnetic field. Also, themagnetic field generation unit 145 uses at least one of a plane coil ora solenoid coil. When an alternating current is applied in a size andshape corresponding to the tactile unit 141, an alternating magneticfield is generated and when a direct current is applied, a directcurrent magnetic field is generated. In particular, lines of magneticflux of the magnetic field generated by the magnetic field generationunit 145 are schematically shown in FIG. 4.

Further, the magnetic field generation unit 145 has a position and ashape corresponding to the tactile unit 141, and the shape of thetactile unit 141 changes due to the magnetic field generated by themagnetic field generation unit 145, and the tactile information may betransmitted according to the shape change of the tactile unit 141. Here,the tactile information may be at least one of vibration, squeeze,tighten, slap, push, tap, tilt, and tickle. Tactile information shouldbe understood to mean sensibility, emotion, etc. [for example, byconveying the tactile feeling of “I love you” through the touch of “

” type, or conveying the tactile feeling of “sad” through the touch of “

” style] transmitted through tactile feeling.

Meanwhile, the tactile delivery unit 140 may be a motor or an actuatorfor transmitting tactile information by generating vibration or thelike. Specifically, the tactile delivery unit 140 may use a tube-shapedactuator including an eccentric motor that vibrates with an eccentricforce generated when the motor rotates, and a linear resonance actuatorthat maximizes the intensity of vibration using the resonance frequency.Also, the tactile delivery unit 140 may use a piezoelectric actuatorhaving a beam shape or a disk shape and driven by using a piezoelectricelement whose size or shape is instantaneously changed by an electricfield, an electroactive polymer actuator that attaches a mass onto anelectroactive polymer film to produce vibrations by repeated movement ofthe mass, and an electrostatic actuator driven by a repulsive forcegenerated when charges of the same kind as the attractive forcegenerated between two glass surfaces filled with different electriccharges are charged. Since the motor or the actuator is a knowntechnology, a detailed description thereof will be omitted.

FIG. 5 is a view showing the tactile delivery unit 140 according to thefirst embodiment of the present invention.

Referring to FIG. 5, the tactile unit 141 of the tactile delivery unit140 according to the first embodiment may have the shape of a fineprotrusion 141 a. In order to convey the tactile feeling in detail andemotionally, the fine protrusion 141 a may have a thickness of about 25μm or less so as to be similar to fleece or the like, or about 100 μm orless so as to be similar to human hair or the like.

As shown in (a) of FIG. 5, the fine protrusion 141 a may maintain aslightly inclined shape (first shape) when it is not affected by theexternal magnetic field. Of course, it is also possible to have a fineprotrusion shape erected vertically without tilting. Next, as shown in(b) of FIG. 5, in the case of being influenced by an external magneticfield, the fine protrusions 141 a may be more inclined or maintain alying shape (second shape). Next, as shown in (c) and (d) of FIG. 5,when the application of the magnetic field is released and is notaffected by the external magnetic field, the fine protrusions 141 a maybe reciprocated by their own elasticity (or resilience) while returningfrom the second shape to the first shape. Therefore, a tactile feelingof rubbing or tickling may be transmitted by the reciprocating fineprotrusion 141 a.

FIG. 6 is a view showing the tactile delivery unit 140 according to thesecond embodiment of the present invention.

Referring to FIG. 6, the tactile unit 141 of the tactile delivery unit140 according to the second embodiment includes a hollow cylindricalbody 141 b, a dome or a polyhedron (see (b) of FIG. 7).

As shown in (a) of FIG. 6, in a case where it is not affected by theexternal magnetic field, the cylinder 141 b in which the inside ishollow may exhibit a flat shape (first shape) of the upper surface 141ba. Next, as shown in (b) of FIG. 6, in the case of being influenced byan external magnetic field, the cylinder 141 b may show a shape (secondshape) in which the upper surface 141 ba is recessed into an emptyspace. Next, as shown in (c) and (d) of FIG. 6, when the application ofthe magnetic field is released and is not affected by the externalmagnetic field, in relation to the cylinder 141 b, the upper surface 141ba may be reciprocated by their own elasticity (or resilience) whilereturning from the second shape to the first shape. Therefore, thetactile feeling and the vibrating tactile feeling may be transmitted bythe reciprocating upper surface 141 ba.

By controlling at least one of the intensity, direction, or frequency ofthe magnetic field formed by the magnetic field generation unit 145, itmay control at least one of the intensity (size), direction, orfrequency of the transformation from the first shape to the secondshape. As an example, if a stronger magnetic field is applied, since thedegree of deformation of the tactile unit 141 will increase, a strongertactile feeling may be delivered. In addition, for example, if thefrequency of the magnetic field is varied, the speed at which thetactile unit 141 returns to the first shape, the second shape, and thenthe first shape changes, so that various tactile feelings may bedelivered.

FIG. 7 is a view showing various shapes of a tactile delivery unit 140according to an embodiment of the present invention.

(1) (a) of FIG. 7 is a hollow cylinder; (2) (b) of FIG. 7 is ahexahedron having an empty interior; and (3) (c) of FIG. 7 is a cylinderformed on the upper surface and empty inside. The air may flow smoothlythrough the micro hole during the reciprocating motion of the uppersurface, thereby increasing the durability of the tactile unit 141. (4)(d) of FIG. 7 shows a shape obtained by mixing a fine protrusion and anempty cylinder, (5) (e) of FIG. 7 shows a shape in which a plurality ofmicro holes are formed on the cylinder upper surface in addition to theshape of (d) of FIG. 7, (6) (f) of FIG. 7 shows a shape having aplurality of micro holes in (c) of FIG. 7, (7) (g) of FIG. 7 shows ashape in which various structures [for example, a cylinder smaller thanthe cylinder and an empty cylinder inside] are combined on the uppersurface of the cylinder, and (8) (h) of FIG. 7 shows a shape in which anembossed structure in the form of a dome is formed on the upper surfaceof a cylinder having an empty interior.

As above, by configuring the shape of the tactile delivery unit 140 invarious ways, the present invention may transmit a variety of tactilefeelings such as a squeeze, a tickle force, a tapping and the like in acomplex manner.

FIG. 8 is a view showing a tactile delivery unit 140 according to athird embodiment of the present invention, and FIG. 9 is a view showinga tactile delivery unit 140 according to a fourth embodiment of thepresent invention.

Referring to FIGS. 8 and 9, in relation to the tactile unit 141according to the third and fourth embodiments, the plurality of tactileunits 141 c and 141 d and the support members 141 ca and 141 da form atleast one cell. A plurality of the cells are disposed on the insulator144 at regular intervals. The coil unit of the plurality of magneticfield generation units 145 may be formed as a single layer or aplurality of layers 145 a and 145 b in a shape and positioncorresponding to the cell below the insulator 144.

Here, the support members 141 ca and 141 da [see FIGS. 8 and 9] arefurther provided between the tactile units 141 c and 141 d and themagnetic field generation unit 145, so that it may be understood thatthe operation space of the tactile units 141 c and 141 d may be secured.In addition, the support members 141 ca and 141 da are MREs, and mayhave at least one shape of a curved shape or a wavy shape.

The tactile unit 141 c according to the third embodiment is in the formof a plate and the support member 141 ca is integrally provided on bothsides of the tactile unit 141 c in a curved shape. The support member141 ca is provided between the insulator 144 and the tactile unit 141 cto secure a space in which the tactile unit 141 c or the support member141 ca may operate. For example, the tactile unit 141 c and the supportmember 141 ca move upward and downward in the space by the magneticfield generated by the magnetic field generation unit 145, and perform areciprocating motion to change the shape. This shape change may move onecell or the entire cell, and as a result, the user may convey varioustactile feelings such as vibration, beating, and tapping.

The tactile unit 141 d according to the fourth embodiment is in the formof a plate and the support member 141 da is integrally provided on bothsides of the tactile unit 141 d in a wavy shape. The support member 141da is provided between the insulator 144 and the tactile unit 141 d tosecure a space in which the tactile unit 141 d may operate. For example,when a magnetic field is generated by the magnetic field generation unit145, the shape of the support member 141 da formed by the MRE changes,and one end of the tactile unit 141 d is inclined toward the center ofthe magnetic field generation unit 145. If no magnetic field isgenerated in the magnetic field generation unit 145, it is possible toreturn to the circular shape by the elastic force. That is, by applyinga magnetic field to one or all of the cells, the user may transmitvarious tactile feelings such as vibration, beating, tapping, ortilting.

FIG. 10 is a view showing the tactile delivery unit 140 according to thefifth embodiment of the present invention.

Referring to FIG. 10, in relation to the tactile unit 141 according tothe fifth embodiment, the plurality of tactile units 141 e form at leastone cell. A plurality of the cells are disposed on the insulator 144 atregular intervals. The coil unit of a plurality of magnetic fieldgeneration units 145 may be formed as a single layer 145 a or aplurality of layers below the insulator 144 in a shape and positioncorresponding to the cell.

The tactile unit 141 e according to the fifth embodiment is in the formof a tunnel, and an elliptical space is formed therein. For example,when a magnetic field is generated by the magnetic field generation unit145, the shape of the tactile unit 141 e formed by the MRE changes, andone end of the tactile unit 141 e is inclined toward the center of themagnetic field generation unit 145. If no magnetic field is generated inthe magnetic field generation unit 145, it is possible to return to thecircular shape by the elastic force. That is, by applying a magneticfield to one or all of the cells, it is possible to transmit varioustactile feelings to the user, such as twisting or tightening.

Meanwhile, although the present invention has been described on theassumption that the material including the magnetic particles 142,typically MRE, is used as the tactile delivery unit 140,Electro-Rheological Elastomer (ERE) material is used, and by applying anexternal electric field through the electric field generating unitinstead of the magnetic field generation unit 145, it is noted that thesame implementation is possible.

As described above, the present invention is capable of deliveringvarious tactile feelings more sensitively through various tactiledelivery units 140.

Tactile Message Providing Method

Hereinafter, a method of providing a tactile message through a tactilemessage providing device and a system including the same will bedescribed in detail.

FIG. 11 is a flowchart showing a tactile message transmission processaccording to an embodiment of the present invention. FIG. 12 is aflowchart showing a tactile message reception process according to anembodiment of the present invention.

A tactile message providing method for transmitting a tactile sense in amobile communication terminal device according to the present inventionincludes: (a) driving a tactile message program; (b) receiving a tactilepattern; (c) converting the tactile pattern into a pattern signal; and(d) transmitting the pattern signal to a reception terminal device. And,the tactile message program includes a tactile pattern input window or atactile switch icon for switching a text input window to a tactilepattern input window. The pattern signal is a signal capable oftransmitting tactile information by operating a tactile delivery unit ofa reception terminal device.

As a first step, the tactile message program may be operated (S100,S200). The sender may prepare a tactile message to be sent by drivingthe tactile message program on the transmission terminal device 100(S100) and the receiver may check the received tactile message bydriving the tactile message program on the reception terminal device 200(S200). At this time, the tactile message on the reception terminaldevice 200 may be confirmed by driving the tactile message program, ormay immediately confirm the tactile message in the form of push ornotification.

FIG. 13 is a view schematically showing screens 500, 600, and 700 of atactile message program according to an embodiment of the presentinvention.

The tactile message program may be a widget, a pop-up program, an app, amessenger app, a short message service (SMS), or a multimedia messageservice (MMS) itself, or may be a program included additionally. (a) ofFIG. 13 shows a widget and a pop-up program in a smartphone. (b) of FIG.13 shows an app form in the smart watch. (c) of FIG. 13 shows that thetactile message program is activated in the form of a messenger app inthe smartphone.

Referring to FIG. 13, the tactile message program includes input windows510, 610 and 710 for inputting tactile patterns, dialog partnerselection windows 530, 630 and 730, message transmission windows 540,640 and 740, and an other menu window 550, 650 and 750. Also,selectively, it may further include a favorites window 520, a dialogwindow 720, and the like. For the Messenger app, since text messagetransmission/reception is basic, it may further include a text inputwindow 701 and an emoticon input icon 705. It may further include atactile switch icon 703 for switching the text input window 701 to thetactile pattern input window 710 [see (c) of FIG. 14].

The tactile message program may be driven through one of methods ofpressing the hard key or button of the mobile communication terminaldevices 100 and 200, touching the display, and rotating or shakingmobile communication terminal devices 100 and 200.

FIG. 14 is a view showing tactile pattern input windows 510, 610, and710 according to an embodiment of the present invention.

In the next step, a tactile pattern may be inputted (S110). The input ofthe tactile pattern is performed through {circle around (1)} a method ofinputting freely, {circle around (2)} a method of inputting using asymbol S, {circle around (3)} a method of selecting a tactile emoticon706, and {circle around (4)} a method of selecting a user emoticon 707,in the input windows 510, 610, and 710, by a user.

On the other hand, after driving the tactile message program, the dialogpartner may be selected before inputting the tactile pattern (S105). Asa dialog partner is selected by touching the dialog partner selectionwindows 530, 630, and 730 in the screens 500, 600, and 700 of thetactile message program, a dialog window may be opened, and a tactilepattern may be inputted through the input windows 510, 610, and 710.

FIG. 15 is a view showing a pattern signal for a tactile patternaccording to an embodiment of the present invention.

Referring to (a) of FIG. 15, for example, if the input unit 110 of thetactile message providing device 100 is an electrostatic touch panel,since the distances between the electrodes vary depending on theintensity (t1<t2<t3) of tapping or touching the input windows 510, 610,and 710, it is possible to generate electric fields of differentintensities, and thus digital signals of different intensities may begenerated. The number of circles in the touched portion shown in (a) ofFIG. 15 represents the intensity of the touch. Then, as shown in (b) ofFIG. 15, in the case of dragging td without hitting the input windows510, 610, and 710, a digital signal of a different pattern may begenerated.

Referring again to FIG. 14, through {circle around (1)} the method, theuser may freely input the tactile pattern through the touch t: t2 of theinput windows 510, 610, and 710. Hereinafter, the tactile messageprogram is assumed to be the messenger application 700, and the tactilepattern is inputted through the input window 710.

The tactile pattern may be generated by a combination of intensity,position, time, and movement direction of the tactile pattern inputwindow 710 in the tactile message program. A digital signal may begenerated independently of each unit pixel or unit area constituting thetactile pattern input window 710. Thus, a pattern signal may beconstituted by a sum of digital signals in each area.

For example, when the input window 710 is tapped more and more strongly(t1->t2->t3), each digital signal having an intensity of 1, 2, and 3 isgenerated, and these digital signals may be combined to form a patternsignal. This pattern signal may be a signal for driving the tactiledelivery unit 140 to cause the tactile delivery unit 140 to transmit atactile sense such that it has an intensity of 1, 2, and 3.

As another example, when touching the input window 710 by dragging fromthe left side to the right side td, a digital signal is generatedindependently from each unit area distributed from the left to the rightof the input window 710, and these digital signals may be combined toform a pattern signal. This pattern signal becomes a signal to drive thetactile delivery unit 140, and the tactile delivery units are drivenfrom the tactile delivery unit 140 disposed on the left side to thetactile delivery unit 140 disposed on the right side, so that tactilesenses may be transmitted.

That is, identically to the tactile pattern input by the user in theinput window 710, or within a degree in which the tactile pattern may beintuitively recognized, the tactile delivery unit 140 is driven totransmit the tactile sense in real time.

On the other hand, the tactile message program may store the tactilepattern DB in advance. When the user inputs a tactile pattern, thecontrol unit 170 matches the input tactile pattern with the tactilepatterns in the tactile pattern DB. If the same or similar tactilepattern is previously stored in the tactile pattern DB, a previouslystored pattern signal may be transmitted.

FIGS. 16 and 17 are views showing that a tactile pattern input window710 according to an embodiment of the present invention is divided intoa plurality of virtual regions 711 and 715 to receive a tactile pattern.

The tactile pattern input window 710 may be divided into a plurality ofvirtual regions 711 and 715. FIGS. 16 and 17 show that it is separatedinto two virtual regions 711 and 715, but it is not limited thereto.Preferably, the number of virtual regions 711 and 715 may be the same asthe number of tactile delivery units 140, or may be divided into anumber that may be mutually matched. Then, it is also possible for theuser to directly specify the number, position, etc. of the virtualregions 711 and 715 and divide them.

As shown in (a) of FIG. 16, when a tactile pattern is inputted bytouching t3 with strong intensity in the left area 711 and touching t1with a weak intensity in the right area 715, as shown in (b) of FIG. 16,a digital signal is generated independently from each of the two virtualregions 711 and 715, and these digital signals may be combined to form apattern signal. This pattern signal becomes a signal to drive thetactile delivery unit 140, and, as shown in (c) of FIG. 16, drives thetactile delivery unit 140 disposed on the left side to have a strongintensity and drives the tactile delivery unit 140 disposed on the rightside to have a weak intensity. Therefore, a tactile message receiverwearing a smart watch may receive stereoscopic tactile information fromthe left and right wrists.

As shown in (a) of FIG. 17, when a tactile pattern is inputted bydragging td from the left area 711 to the right area 715, as shown in(b) of FIG. 17, a digital signal is generated independently from each ofthe two virtual regions 711 and 715, and these digital signals may becombined to form a pattern signal. This pattern signal becomes a signalto drive the tactile delivery unit 140, and as shown in (c) of FIG. 17,may sequentially drive tactile delivery units 140 from the tactiledelivery units 140 aa, 140 ab, 140 ac, . . . arranged in the left columntoward the direction of the tactile delivery unit 140 ca, 140 cb, 140cc, . . . arranged in the right column. Therefore, a tactile messagereceiver holding a smartphone may receive tactile information flowingfrom left to right like a wave. If wearing a smart watch, he/she willreceive tactile information rotating around the wrist.

As described above, the present invention is advantageous in that thetactile pattern inputted by the user through the input window 710 may beconverted into stereoscopic tactile information having directionalityand transmitted.

FIG. 18 is a view showing that a symbol S is provided in a tactilepattern input window 710 according to an embodiment of the presentinvention.

As {circle around (2)} the method, the user may input a tactile patternby touching t: t2 the symbol S displayed on the input window 710. Whenthe tactile pattern is freely input by the method described in FIG. 14,a complicated pattern or an unclear pattern may be inputted so that itis difficult to operate the tactile delivery unit 140 in the tactilemessage providing device 100. In this case, the inputted tactile patternmay be deleted, or it may be troublesome to request re-input. To preventthis, a symbol S in the form of an image may be displayed on the tactilepattern input window 710.

The symbol S plays a role of attracting a user's attention and helpingthe user to intensively touch and drag a portion where the symbol S isdisplayed. The tactile pattern inputted through the portion where thesymbol S is displayed may be organized in advance and provided asdatabase in advance. Thus, the tactile message providing device 100 maygenerate a tactile pattern to facilitate operation of the tactiledelivery unit 140.

In addition, the symbol S may generate not only a tactile pattern(pattern signal) but also generate a content signal corresponding to thesymbol S. The content signal may reproduce effects such as hearing andsmell. For example, as shown in FIG. 16(a), when a tactile pattern isgenerated and transmitted by touching a drum-shaped symbol S2, thereceiver receives tactile information of tapping from the tactiledelivery unit 140 and receives a drum-like sound from the contentdelivery unit 150 such as a speaker at the same time. Also, as shown in(b) of FIG. 16, when a tactile pattern is generated by dragging adrum-shaped symbol S in a shaking form, the receiver receives thetactile information of the knocking and vibration alternately from thetactile delivery unit 140 arranged on the left and right of theplurality of tactile delivery units 140 and receive the sound of a drumbeat of a fast bit from the content delivery unit 150.

FIG. 19 is a view showing that a tactile pattern input window 710according to another embodiment of the present invention is divided intoa plurality of virtual regions 711 to 717 and a symbol S is provided.The embodiment of FIG. 19 may be understood as a combination of theabove-described embodiments in FIGS. 16 and 18.

Each of the seven white keys in the keyboard symbol S constitutes aplurality of virtual regions 711 to 717, and each of the virtual regions711 to 717 may be matched to tactile delivery units 140 a to 140 g toindependently operate each of the tactile delivery units 140 a to 140 g.For example, if the sender touches the keyboard in the order of711->713->715, the receiver receives tactile information in the order of140 a, 140 c, and 140 e. In addition, Do, Mi, and Sol corresponding tothe notes of the keyboard may be provided as auditory information fromthe content delivery unit 150.

FIG. 20 is a view showing a screen 760 for selecting a tactile emoticon706 according to an embodiment of the present invention, and FIG. 22 isa view showing pattern signals for various emotions according to anembodiment of the present invention. In FIG. 22, it is assumed anddescribed that the solid line pattern signal drives the left tactiledelivery unit 140 among the arranged tactile delivery units 140, and thedotted line pattern signal is a pattern signal for driving the tactiledelivery unit 140 on the right side.

Referring to FIG. 20, as {circle around (3)} the method, a user mayinput a tactile pattern by selecting a tactile emoticon 706 provided ina tactile message program. The tactile emoticon 706 stores a tactilepattern corresponding to the image of the tactile emoticon 706, and whenthe user selects the tactile emoticon 706, the corresponding tactilepattern may be inputted.

As an example, if selecting a tactile emoticon 706 a representing“hahaha”, joy, and exciting, an image of the tactile emoticon 706 a isdisplayed on and transmitted to the dialog window 720, and a patternsignal of a tactile pattern corresponding to the tactile emoticon 706 amay be transmitted. (a) of FIG. 22 is an example of a pattern signalcorresponding to the tactile emoticon 706 a. In order to intuitivelyexpress feelings of “Ha Ha Ha”, joy, and exciting, the pattern signal isconfigured to transmit tactile information of a feeling of jumping.

As an example, if selecting a tactile emoticon 706 b representing “loveyou” and heart, an image of the tactile emoticon 706 b is displayed onand transmitted to the dialog window 720, and a pattern signal of atactile pattern corresponding to the tactile emoticon 706 b may betransmitted. (b) of FIG. 22 is an example of a pattern signalcorresponding to the tactile emoticon 706 b. In order to intuitivelyexpress feelings of “love you” and heart, the pattern signal isconfigured to transmit tactile information of a feeling of throbbing.

FIG. 21 is a view showing a screen 770 for selecting a user emoticon 707according to an embodiment of the present invention.

Referring to FIG. 21, as {circle around (4)} the method, the user mayarbitrarily create the tactile message through the tactile pattern inputwindow 710 of the tactile message program and input the tactile patternby selecting the user emoticon 707 which is stored in advance. Theemoticon image and the corresponding tactile pattern are stored in theuser emoticon 707 in combination of intensity, position, time, anddirection of movement that the user touches, and when the user selectsuser emoticon 707, the corresponding tactile pattern may be inputted.

As an example, if selecting a tactile emoticon 707 a representing“sadness”, an image of the corresponding user emoticon 707 a isdisplayed and transmitted in the dialog window 720, and a pattern signalof a tactile pattern included in the user emoticon 707 a may betransmitted simultaneously. (c) of FIG. 22 is an example of a patternsignal corresponding to the user emoticon 707 a. In order to intuitivelyexpress the feelings of “sadness”, the pattern signal may be stored soas to transmit tactile information of a feeling of crying.

As another example, if selecting a tactile emoticon 707 b representing“angry”, an image of the corresponding user emoticon 707 b is displayedand transmitted in the dialog window 720, and a pattern signal of atactile pattern included in the user emoticon 707 b may be transmittedsimultaneously. (d) of FIG. 22 is an example of a pattern signalcorresponding to the user emoticon 707 b. In order to intuitivelyexpress the feelings of “angry”, the pattern signal may be stored so asto transmit tactile information of a feeling of shouting suddenly.

On the other hand, the user may input a tactile pattern and receive atactile feedback to send. In addition, the memory unit 130 may store ahistory of the tactile pattern, date, and dialog partner sent by theuser, and may provide the user with a history.

Referring again to FIG. 11, a tactile signal (pattern signal)corresponding to the inputted tactile pattern may be transmitted (S120).The control unit 170 may encode the tactile pattern inputted through theinput unit 110 as a pattern signal. The process of encoding the tactilepattern into the pattern signal is as described above with reference toFIGS. 15 to 17. The encoded pattern signal is transmitted to thecommunication unit 160, and the communication unit 160 may transmit thepattern signal to the communication unit of the reception terminaldevice 200.

The content signal may be transmitted along with the transmission of thetactile signal (pattern signal). In addition to the process of inputtingthe tactile pattern (S110), a process of inputting the content S115 maybe further performed. The content may include dialogue text, sounds,sound effects, and the like.

In the next step, tactile information and content information may betransmitted (S130). The transmission of the tactile/content informationmay be performed by reproducing the tactile information and the contentinformation through the tactile delivery unit and the content deliveryunit of the reception terminal device 200. The tactile delivery unit 150may be driven in response to a tactile signal (pattern signal) asdescribed above with reference to FIGS. 15 to 22.

Referring again to FIG. 12, from the perspective of a receiver, a methodof providing a tactile message will be described.

The reception terminal device 200 may confirm whether or not there is atactile pattern (tactile signal) in the transmitted signal (S210). Whenthe received signal includes only image signals such as a simple textsignal, an emoticon, and a photograph, the dialog window 720 of thereception terminal device 200 may display only text and images. If it isdetermined that the tactile pattern (tactile signal) is included in thetransmitted signal, the signal transmitted from the control unit may berecorded in the memory unit. When transmitting a message signal at thetransmission terminal device 100, by transmitting only theidentification code identifying that the tactile pattern (tactilesignal) is contained in the message signal, the presence or absence ofthe tactile pattern may be checked at the reception terminal device 200.

Meanwhile, the reception terminal device 200 may confirm whether or notthe content signal is included in addition to the tactile pattern(S215). If it is determined that the received signal includes a contentsignal (simple text, content signal such as auditory sense or olfactorysignal except image), the signal received from the control unit may berecorded in the memory unit. When transmitting a message signal at thetransmission terminal device 100, by transmitting only theidentification code identifying that the content signal is contained inthe message signal, the presence or absence of the content signal may bechecked at the reception terminal device 200.

In the next step, the tactile/content signal received from the controlunit is received and written to the memory unit, and the control unitprepares for processing (S220).

In the next step, the control unit may reproduce the visual information,the tactile information, and the content information including the text,image, and the like through the display unit, the tactile delivery unit,and the content delivery unit (S230).

FIG. 23 is a view showing a screen for receiving tactile messages 721,722, and 723 according to an embodiment of the present invention. (a) ofFIG. 23 shows a tactile message 721 inputted by the sender freely orusing the symbol S. (b) of FIG. 23 shows a tactile message 722transmitted by selecting the tactile emoticon 706. (c) of FIG. 23 showsa dialog window 720 in which a tactile message 723 transmitted byselecting the user emoticon 707 is displayed.

As shown in (a) of FIG. 23, the tactile information ti corresponding tothe tactile signal (pattern signal) included in the tactile message 721may be transmitted to the receiver. Also, as shown in (b) and (c) ofFIG. 23, when the tactile messages 722 and 723 simultaneously includethe tactile signal (pattern signal) and the content signal, thecorresponding tactile information ti and content information si may betransmitted to the receiver.

After running the tactile message program and selecting the dialogpartner, by touching the tactile messages 721, 722, and 723, thereceiver may receive tactile information ti and content information si.In addition, the sender may transmit tactile information ti and contentinformation si to the receiver in the form of push and notificationimmediately after the sender sends the tactile message. The tactileinformation ti and the content information si may be received at thesame time, or sequentially received at predetermined intervals. This maybe changed freely through the setting of the tactile message program.

If the reception terminal device 200 of the receiver is included as asingle module in which only one tactile delivery unit 140 is installed,tactile information ti such as vibration, hitting, pushing, and tappingmay be received. And, when the reception terminal device 200 of thereceiver includes a plurality of tactile delivery units 140 as aplurality of modules, it is possible to receive tactile information tihaving directionality such as squeezing, tightening, tilting, andtickling force in addition to the form of the tactile information ti.

Meanwhile, according to another embodiment, without touching the screenof the tactile message program, the tactile pattern may be inputted. Ifthe sender may not touch the screen of the tactile message program, forexample, if a mobile phone is on the cheek, touching on the touch panelmay be difficult. This is more difficult during a call when theproximity sensor is activated and the display screen is turned off.

In this case, the sender may input a tactile pattern using a method oftapping, rotating, or shaking the transmission terminal device 100.First, during the call, by pressing the hard key or button of thetransmission terminal device 100, or tapping the body of the terminaldevice, it is possible to create a state of entering a tactile pattern.Then, if the transmission terminal device 100 is directly tapped,rotated, shaken, or brought into contact with a magnetic material,acceleration sensors, gyro sensors, gravity sensors, magnetic sensors,etc. may recognize this pattern. The control unit 170 may generate atactile pattern by encoding this pattern. Then, the tactile informationcorresponding to the tactile pattern may be transmitted to the receiver.

As described above, according to the present invention, as the tactilemessage is transmitted through the tactile sense, it is possible toavoid limiting the expression of the user due to existing messageservices primarily based on visual. In addition, as promptly inputting afeeling of a sender in a tactile pattern, it is possible to transmitvarious tactile feeling such as vibration, squeeze, tightening, hitting,pushing, tapping, tilting, and tickling force to the receiver moresensitively, and the tactile feeling may be delivered in a formcorresponding to the user's emotions. Thus, there is an effect thatemotions that a user feels in various situations allows other people tofeel the same feeling.

While the present invention has been particularly shown and describedwith reference to exemplary embodiments thereof, the present inventionis not limited to the above embodiment, and within the spirit of thepresent invention, various changes and modifications may be made bythose skilled in the art. Such variations and modifications are to beconsidered as falling within the scope of the invention and the appendedclaims.

1. A tactile message providing method for a tactile sense in a mobilecommunication terminal device, the method comprising: (a) driving atactile message program; (b) selecting a dialog partner; (c) receiving atactile pattern; (d) converting the tactile pattern into a patternsignal; and (e) transmitting the pattern signal to a reception terminaldevice, wherein step (c) comprises at least one of: selecting anemoticon, and receiving a tactile pattern which includes at least one ofan intensity, a position, a time, and a movement direction that a usertouches a tactile pattern input window of the tactile message program.2. The method of claim 1, wherein the tactile pattern is a combinationincluding at least two of an intensity, a position, a time, and amovement direction that a user touches the tactile pattern input windowof the tactile message program.
 3. The method of claim 1, wherein instep (c), the emoticon includes an image corresponding to the message tobe transmitted by the user, when the emoticon is selected, a tactilepattern corresponding to the image is received.
 4. The method of claim3, wherein the emoticon is a tactile emoticon provided by the tactilemessage program or a user emoticon previously stored by the user.
 5. Themethod of claim 1, wherein the tactile message program comprises atactile pattern input window or a tactile switch icon for switching atext input window to a tactile pattern input window, and wherein thepattern signal is a signal capable of transmitting tactile informationby operating a tactile delivery unit of the reception terminal device.6. The method of claim 1, wherein the tactile message program is awidget, a pop-up program, an app, a messenger app, a short messageservice (SMS), or a multimedia message service (MMS) itself, or isincluded therein.
 7. The method of claim 1, wherein the tactile patterninputted by the user is matched with a tactile pattern DB previouslystored in the tactile message program and a pattern signal of thetactile pattern DB is transmitted to the reception terminal device. 8.The method of claim 1, wherein the tactile pattern input window isdivided into a plurality of virtual regions, and the virtual regionreceives a tactile pattern to generate a digital signal independently,and the pattern signal is composed of a sum of the generated digitalsignals.
 9. The method of claim 8, wherein the pattern signal is asignal capable of transmitting stereoscopic tactile information havingdirectionality, by operating each tactile delivery unit of the receptionterminal device corresponding to each of the virtual regions.
 10. Themethod of claim 1, further comprising: (f) receiving content, and (g)transmitting content signal to the reception terminal device.
 11. Themethod of claim 10, wherein the content includes at least one ofdialogue text, sounds, sound effects, pictures, and videos.
 12. Themethod of claim 10, wherein steps (e) and (g) are performedsimultaneously or sequentially.
 13. The method of claim 1, wherein thetactile message includes at least one of vibration, squeeze, fasten,punch, push, tap, tilt, and tickle.
 14. A nonvolatile computer-readablerecording medium, in which a program of a tactile message providingmethod executable by a processor of a mobile communication terminaldevice is recorded, the method comprising: (a) converting a receivedtactile pattern into a pattern signal; and (b) transmitting the patternsignal to a reception terminal device, wherein the tactile messageincludes tactile information or tactile information and contentinformation.